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Abstract — Binary message-passing decoders for low-density 
parity-checli (LDPC) codes are studied by using extrinsic in- 
formation transfer (EXIT) cliarts. Tlie channel delivers liard 
or soft decisions and tlie variable node decoder performs all 
computations in the L-value domain. A hard decision channel 
results in the well-know Gallager B algorithm, and increasing 
the output alphabet from hard decisions to two bits yields a gain 
of more than 1.0 dB in the required signal to noise ratio when 
using optimized codes. The code optimization requires adapting 
the mixing property of EXIT functions to the case of binary 
message-passing decoders. Finally, it is shown that errors on 
cycles consisting only of degree two and three variable nodes 
cannot be corrected and a necessary and sufficient condition for 
the existence of a cycle-free subgraph is derived. 

Index Terms — extrinsic information transfer charts, Gallager 
B Algorithm, irregular codes, low-density parity-check codes, 
message-passing decoding 
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I. Introduction 

Gallager introduced low-density parity-check (LDPC) codes 
|[T], ||2J and also presented message-passing decoding al- 
gorithms that exchange only binary messages between the 
variable and check nodes. These algorithms are referred to as 
Gallager A and Gallager B |3| depending on how the variable- 
to-check node messages are computed. The algorithms have 
small memory requirements and low complexity implementa- 
tions, especially of the check node decoder, and they have 
found practical use in high-speed applications, e.g. optical 
transmission systems [4|. However, the complexity advantages 
come at the cost of a significant loss in performance. 

In this work, we use extrinsic information transfer (EXIT) 
charts Ul, {T\, |T|, (6) to analyze and design binary message- 
passing algorithms. Interestingly, in contrast to non-binary 
message passing where they are an approximation, EXIT 
charts are exact for the case of binary messages (and infinite- 
length code ensembles) since the mutual information de- 
scribes the probability densities of the messages precisely. 
Furthermore, the EXIT functions for binary message-passing 
algorithms can be derived analytically |[T|, Q. 

Binary message-passing algorithms were studied in |j7|, 
||8) where the authors showed that optimum algorithms must 
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satisfy certain symmetry and isotropy conditions. In contrast 
to majority based decision rules, we assume that the variable 
node decoder converts all incoming messages to L-values I^J, 
performs decoding in the L-value domain and applies a hard 
decision on the result. Note that for these algorithms, there 
always exist majority decision rules that can be derived in a 



straightforward way as shown in Section V-B This general 
approach assures that the symmetry and isotropy conditions 
are satisfied and the algorithms can be extended for systems 
where the channel provides more information than hard deci- 
sions, while the variable and check node decoder still exchange 
binary messages only. This reduces the gap between optimum 
decoding and binary message-passing decoding, while the 
complexity is kept low. 

Our main contributions are as follows: 

• We derive a framework that allows binary message- 
passing algorithms to incorporate various quantization 
schemes for the channel messages. Increasing the number 
of quantization bits from one to two leads to a signifi- 
cantly improved decoding performance. 

• We identify certain structures of the factor graph which 
cannot be corrected by binary message-passing decoders. 
Therefore, in addition to the stability condition, the 
degree distribution has to satisfy another constraint in 
order to avoid error floors. An important consequence is 
that regular LDPC codes with variable node degree three 
cannot be decoded without an error floor 

The rest of this paper is organized as follows. In Sec- 
tion |II] we introduce basics and definitions which are used 
in Section [III] to derive the EXIT functions of the variable 
and check node decoders. In Section |IV[ we show how the 
EXIT functions can be used to optimize the code and derive 
constraints on the degree distributions. Section [V] considers 
practical aspects of binary message-passing decoders and 
simulation results are presented in Section [Vl] 

II. Preliminaries 

For binary message-passing decoders, the extrinsic channel 
|6J of the variable and check node decoder is represented as 
a binary symmetric channel (BSC) with input X and output 
Y both with alphabet {+1,-1}. Let e denote the crossover 
probability of the BSC which we assume to be less than or 
equal to 0.5. Since there is a one-to-one relation between 
mutual information I{X; Y) and crossover probability for the 
BSC, we can equivalently describe those channels using 



I{X;Y) = l-hbie) 



(1) 
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where /if,( ) denotes the binary entropy function 

h{e) = -e\og^{e) - (1 - e)log2(l - e). (2) 

The variable node decoder converts all messages to L-values 
using 

Pr [X = +1\Y = y] 



L{y) = loj 
= log 



Pr [X = -l\Y = y] 
Pr [Y = y\X = +1] 



(3) 



Pr [Y = y\X = -1]' 

where y is a realization of Y and we assumed that 
Pr [X = +1] = Pr [X = -1] = 1/2. Defining the reliability 
associated with a BSC as 

D = log ^— ^ > 
e 

allows to express the L-value as 

L{y)^yD. 



(4) 



(5) 



Throughout the paper, random variables are denoted by up- 
percase letters and their realizations are denoted by lowercase 
letters. The indices v, c, a, and e stand for variable node de- 
coder, check node decoder, a-priori and extrinsic, respectively. 

III. EXIT Functions of Component Decoders 

A. Check Node Decoder 

A check node of degree dc of a binary message-passing 
algorithm computes the output message of each of its edges 
as the product of the other d^. — 1 edge inputs when using 
the alphabet {+1,-1}. Let e^c denote the average bit error 
probability at the input of the check nodes. The correspond- 
ing a-priori crossover probability of the extrinsic channel is 
therefore also eac- We define lac = 1 ~ hb{eac) so that 
Eac = ^1(7^(1 ~ lac) where h^^{x) takes on values in the 
interval [0, 1/2]. The crossover probability at the check node 
output is [2, Lemma 4.1] 

ft 1 - (1 - 2eacr^-^ _ 

fee = Jc{eac] dc) = (6) 

where fc is the EXIT function of a check node of degree de- 
Using (j6|l and ([T]l, we define Ice = I — ^b(eec)- The inverse 
of the EXIT function in (|6| reads 



fc \<^ec]dc) = 



B. Variable Node Decoder 



l-(l-2eec)^ 



(7) 



For a variable node of degree d^, every outgoing message 
Ley J along edge j of the variable node is given by 



Lc 



E 



(8) 



where Let is the L-value from the channel (see (|9| below) and 
Lav,i is the L-value from the check nodes along edge i of the 
variable node. To perform this summation, all messages must 
be converted to L-values using Q and (jSj), where we assume 
that the variable node decoder knows the parameters of the 



communication and extrinsic channels. We show in Section IVll 
how the decoder can be implemented without this knowledge. 
In the following, we assume the communications channel is 
an additive white Gaussian noise channel with binary input 
(BIAWGN) and noise variance af^ so the received values y 
are converted to L-values as 



Leh — 



TV 



(9) 



before being quantized. Conditioned on X = +1, the unquan- 
tized L-values are Gaussian random variables with variance 



(T~^ = 4/o-„ and mean fieh = (^ch/^ | |10) . In the following, 
we derive the EXIT functions for three different quantization 
schemes. 

1) Hard Decision Channel: Consider the case where the 
receiver performs hard decisions. Then the decoder's commu- 
nication channel can be modeled as a BSC with crossover 
probability 



g{l)dl 



(10) 



where g{l) = Pl\x{1\ + 1) is the conditional transition proba- 
bility of the actual communication channel. Any symmetric 
channel with binary input is completely described by g{l) 
which is therefore sufficient to analyze the decoding behavior. 
Let Dch and Dav denote the reliabilities of the decoder's 
communication and extrinsic channels, respectively (see ||6] 
Fig. 2 and Fig. 3]). The variable node decoder computes the 
outgoing message on edge j by using ([8]) with Leh ~ V ■ Dch- 
The outgoing message transmitted to the check node decoder 
is the sign of Lev To compute the error probability of the 
message, we consider two cases. First, assume that the channel 
message is in error This error is corrected if the sum over the 
Lav.i in ([SJ can overcome the incorrect sign on Leh, i-C-, if 



-Dch - ncDav + [dv - 1 - rie)Dav > 



(11) 



where Ue is the number of erroneous messages from the check 
nodes. An equivalent condition is Ue < t where 



t = 



DaUdv-l)-D. 



ch 



2D„ 



(12) 



Similarly, if the channel message is correct, then Ue has to be 
less than or equal to 



t 



Dgyjdy -l)+De 

2D 



(13) 



to result in a correct outgoing message. Combining these two 
cases yields the error probability of the outgoing messages of 
the variable node decoder 



fv{^avj dv: ^ch) 

1 — EchB {t; dv — 1, €av) 

-(1 - ech)B (t; dy ~ 1, eav) 



where 



i=0 



(14) 



(15) 
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Fig. 1. Quantization sclieme for cliannel messages. 



denotes the binomial cumulative distribution. The EXIT func- 
tion ( [T4) l serves as a lower bound on EXIT functions for (ap- 
propriately designed) soft-decision detectors, see Section [Tll-C| 
below. 

2) Soft Decision Channel: In the limit of no quantization 
of the output of a BIAWGN channel, the crossover probability 
at the output of the variable node is 

ee„=Pr[Le.,j <0|X = +1] 

= Pr L,,h+ Lav.i<0 

Pr [-L^h + f^ch > Davids - 1 - 2z) + Hch\ X = +1] 

, 1 f Dav{dv - I - 2z) + Hch\ 
= } b(z; dy - 1, CavjQ , 

(16) 



X = +1 



where Nc is a random variable representing the number of 
erroneous messages from the check nodes, where 



1 



/2n 



e ^ dip 



(17) 



is the familiar Q function, and where 



/(I 



P) 



(18) 



denotes the binomial probability mass function. The EXIT 
function ([T6| serves as an upper bound on the EXIT function 
of any quantization scheme, see Section III-C below. 

3) Output Alphabets Larger than Binary: Suppose a quan- 
tizer provides the sign sign{Lch) and a quantization index w, 
w = 0, . . . , W, of the magnitude \Lch\- The boundary points 
of the quantizer are defined by the vector C ~ [Coj • ■ • ,Cw] 
where < < Ci < ■ ■ ■ < (w- Such a quantization scheme 
is depicted in Figure [T| 

Following pT) , | [T2| , this channel quantization scheme can 
be decomposed as 1) BSCs. Sub-channel w is used with 
probability p^,, has cross-over probability ech,w and reliability 
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Fig. 2. Binary message passing EXIT functions of clieck nodes witli dc = 6 
and variable nodes with d„ = 4, d = 1.90 and a = 0.67 for BSC, BSQC 
and soft decision channel. 



Dch,w For w > we have 



py, = I g{l)dl + / g{l)dl, 

ech,w = — / 9{l)dl, and 

Pw J-c™ 

cKw = log 



(19) 

(20) 
(21) 

We define sub-channel zero {w = 0) as a BSC with crossover 
probability 0.5 pT) , | [T2| . The parameters for sub-channel zero 
are 



Co 

po = / gQ-)di, 

-Co 



(22) 

(23) 
(24) 



The EXIT function of the overall channel is given by the 
expectation of the EXIT functions of the sub-channels | |TT| , 

mi 



w 



(25) 



■iu=0 



where eev,w is given by ([14]) with e^/i = ech,w 



C. Examples 

Figure |2] shows examples of the EXIT functions for check 
and variable nodes for a regular LDPC code with variable node 
degree dy — A and check node degree dc = 6. In Figure [2] 
we use 4„ = 1 - hb{€av), lev = 1 - hb{eev) and similarly 
for lac and I^c- The EXIT function for the hard decision 
channel (BSC) changes its behavior at certain values of lav 
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These values correspond to a change of the majority decision 
rule of the Gallager B algorithm |3|. The EXIT function for 
the soft decision channel is an upper bound for all quanti- 
zation schemes. As an example for larger output alphabets, 
we consider a binary symmetric quaternary output channel 
(BSQC) where the output of the channel takes on values from 
{-Dcha^-Dch.i,+Dch.,i,+Dch,2}- This channel output can 
be represented by a quantization using 

C = [0, Ci, (26) 

Notice that for this case p2l ) gives po = 0. In Figure |2] the 
EXIT function is shown for (^i = 1.90. 

IV. Irregular Codes 

In this section we consider irregular LDPC codes, their 
EXIT functions, and constraints that have to be satisfied to 
avoid error floors. The results will be used in Section [Vl] to 
optimize the degree distribution of the variable nodes. We 
focus on check-regular codes, i.e. all check nodes have the 
same degree dc, but the analysis extends in a simple way to 
check-irregular codes. 

A. Mixing of EXIT Functions 

We first prove the following theorem that is stated in a 
different context in |13|. Recall that g(Z) = Pl\x{1\ + ^) is the 
conditional probability density of a channel from X to L. 

Theorem 1. Consider a collection of channels {gi{l)}i that 
satisfy gi{—l) — e^gi{l) for all i. We then have 

Y,KI{X,-Li) = I{X-L) (27) 

i 

where 

i 

In other words, for < < 1 and \i — 1, the 
average EXIT function of the channel collection equals the 
EXIT function of the "averaged" channel. 

Proof Since g{l) = Pl\x{A + 1) = Pl\x{-1\ - 1), we 
obtain (note the integral limits) 

I{X\L) =h{L) - h{L\X) 

= f -b(0 + .,H)l.oB?«±?(zl) 

+ g(0 log 5(0 + .9(-0 ^ogg{-l)dl. (29) 

Using the symmetry condition g{—l) = e~^g{l) this simplifies 
to 

liX; L) = £ g{l) |e-' log ^ + log | dl 

(30) 

which is a linear operation on g{l). Hence the order of 
summation and computation of mutual information may be 
swapped. ■ 
Theorem [T] implies that the EXIT function of a mixture of 
codes can be computed as the average of the EXIT functions 



of the component codes as long as the channels to the L- 
values satisfy the property g{—l) ~ e^g{l)- In the case of 
binary message-passing decoders, however, the outgoing L- 
values of the variable node are quantized to {+Dev, —Dev}- 
This nonlinear operation prohibits the exchange of averaging 
and the computation of the mutual information. On the other 
hand, the mixture EXIT function can still be computed by 
averaging over the crossover probabilities instead of the EXIT 
functions jlj, |[T4|, i.e., we have 

£ev = ^ifyj^av', h ^ch) (31) 

i 

where A; denotes the fraction of edges connected to a variable 
node of degree i |3| and fv{-) is given by ([T4|. Furthermore, 
we can formulate the successful decoding constraint in terms 
of crossover probabilities 

ee. =5]A,/,(e;i,eeh)</-'(e) (32) 

i 

for all e G (0, 0.5). Expressing the design rate of a code as 



R = l- ^ (33) 
leads to a linear program for maximizing the design rate: 

maximize — (34) 

^-^ i 

subject to ^ X^fv{.e\ i, ech) < fc\<^) V e € (0, 0.5) 

i 

< Ai < 1. 

In practice, the first constraint is evaluated for a fine grid of 
discrete e. This linear program enables the efficient optimiza- 
tion of the variable node degree distribution. 

B. Stability 

It has been shown in \^ that if the degree distribution 
of an LDPC code satisfies a stability condition, the decoder 
converges to zero error when starting from a sufficiently 
small error probability. The stability condition for the binary 
message-passing decoder is given in the following theorem. 

Theorem 2. An irregular LDPC code satisfies the stabil- 
ity condition under binary message-passing decoding (using 
quantized or unquantized channel messages) if and only if the 
variable node degree distribution satisfies 

(A2 + 2e,a3)(4-l) < 1, (35) 

where ech denotes the error probability of a hard decision of 
the channel messages. 

Proof: Let the superscript denote the error probabilities 
at iteration £. Furthermore, let eic* = and ea^t^^ — ^ic 
denote the error probabilities from the variable to check nodes 
and from the check to variable nodes, respectively. According 
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to ^25) , the EXIT function of the variable node decoder with 
quantized channel messages is the expectation of the EXIT 
functions of the sub-channels. Combining (|6]), ([T4| and (|25]l 
leads to 



w=0 
W 

= ^Pwfv (^/c(ei^J; 4); dv,£ch,w ] ■ (36) 



w=0 



For small error rates, it suffices to consider only the first 
order Taylor series expansion over one iteration |3|. Stability 
implies that the error probability decreases over one iteration 
for sufficiently small error probabilities, i.e., we have 



lim 



dfviiT,dy,ech,w) 
di] 




lim 



w 



i lim 



drj 



■ lim f'J^) < 1, 
(37) 



where the final step follows because fdei^v ; dc) — > as eiv — ^ 
0. For the check node (|6]l, we have 



dr - 1. 



(38) 



v^o \ drj 

For the variable node decoder we start with the binomial 
cumulative distribution 



lim —B(k;n,p) = lim — V . )p\l - pj 
P^o dp p^odp-^KiJ 

i—O 

—n ; fc = 
: fc > • 



(39) 



Using this result with ( [T4] i and ( p5] l and the fact that for Eav — > 
the reliability of the channel message Dch is small compared 
to the reliability of the a-priori message Dav, for regular LDPC 
codes we get 



w , 

EPw lim 



dfv{r];dv,ech,w) 
drj 
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d^=2 

d^=3 . (40) 
d„ > 4 



The expectation of the error probabilities of all sub-channels 
equals the error probabihty of a hard decision channel ech — 




Fig. 3. Cycle formed by variable nodes of degree two and three. 



J2tu=oPw^ch.w Since every binary input symmetric output 
channel can be decomposed into BSCs pT| , |12|, ( |40] l is 
also valid for unquantized channel messages by setting Cch = 



For irregular LDPC codes ( (3T| ) leads to 



tu=0 



lim 

77->-0 



drj 



(41) 

Combining ( (38] l and ( |4l] i with ( (37] i yields the theorem. ■ 
We note that this stability condition is the same as for Gal- 
lager's original algorithm B (with hard decisions) as derived in 
I?] Eq. (11)], i.e. a finer quantization of the channel messages 
does not change the stability condition. The stability condition 
imposes a linear constraint on A2 and A3 and can hence be 
incorporated in the linear program ([34]) for code optimization. 

For regular LDPC codes with d^, = 2, the left side of ( |35| l is 
dc — 1, which cannot be less than one. Therefore, such codes 
exhibit an error floor with binary message-passing decoding. 
Regular codes with dy = 3 satisfy the stability condition if 
^^chidc — 1) < 1. However, we show in the next section that 
these codes also exhibit an error floor with binary message- 
passing decoding. 

C. Effect of Cycles 

As shown in p3) , cycles are unavoidable in the factor 
graph of finite length LDPC codes. Some cycles lead to error 
floors because they lead to poor properties of the code itself, 
e.g. cycles of length g that include only variable nodes of 
degree two lead to a minimum distance d,nin < f- For binary 
message-passing decoders, we identify cycles that lead to error 
floors that are caused by the decoding algorithm and not by 
the properties of the code. 

Theorem 3. Consider a cycle formed by variable nodes 
of degree two and three only and assume that the channel 
messages associated with the nodes in the cycle are in error 
If all other incoming messages at the check nodes of the cycle 
are correct, then the variable nodes forming the cycle cannot 
be corrected by the binary message-passing decoder 

Proof: An example of a cycle of interest is shown in 
Figure [3] where the left edges correspond to the channel 
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messages which are all assumed to be in error. In the first 
iteration the variable nodes send out their received messages. 
Since every check node in the cycle is connected twice to the 
set of erroneous variable nodes, the outgoing messages from 
the check nodes are also in error 

In the following iteration, the outgoing messages at the 
variable nodes are computed according to ([8|. For degree 
two variable nodes (Vi and V2), the extrinsic L-value is the 
sum of the channel L-value and the L-value of the other 
incoming message. Since both messages are in error, the 
outgoing message is also in error. For variable nodes of degree 
three, one message is not involved in the cycle (as shown for 
V3 in Figure [3]). Even if this message is correct, the extrinsic 
L-value is the sum of the channel L-value and two L-values 
from the check nodes with same magnitude but different signs. 
Therefore, the outgoing message is the sign of the channel L- 
value which is in error. Since this leads to the same state as 
after the first iteration, the decoder is not able to correct the 
errors of the variable nodes in the cycle. ■ 

If the factor graph contains cycles consisting of variable 
nodes of degree two and three only, there is a nonzero 
probability that the involved channel messages are in error 
leading to a decoding failure. Similar to stopping sets |16|, 
this situation leads to error floors. According to Theorem |3] to 
avoid an error floor, the factor graph of an LDPC code must 
not have such cycles. Such a graph exists if the following 
condition is satisfied. 

Theorem 4. A factor graph with no cycles of variable nodes 
of degree two and three exists if and only if 



3A2 



4A., < 



6 (1 - i?) - ^ 



N 



< 



6 



(42) 



4 (1 - i?) ^ 4 

Proof: Let denote the fraction of variable nodes of 
degree i, i.e. the node perspective of the variable node degree 
distribution |[3|. Furthermore, let N and M denote the number 
of variable and check nodes, respectively. The maximum 
number of nodes in the subgraph containing only degree two 
and three variable nodes is 



A2N + A-iN + M. 



(43) 



This subgraph is cycle-free only if the number of edges Et in 
the sub-graph is at most one less than the number of nodes 

Et < A2N + A3N + M - 1. (44) 

Furthermore, such a subgraph exists if (|44]i is satisfied. Since 
Et = 2A2iV + iAsN, the bound (|44| is 

M - 1 

A2 + 2A3<— — . (45) 



N 



Using 



A,; = 



(46) 



3 3 



to convert from node perspective A^ to edge perspective Ai, 
and expressing the design rate R of the LDPC code as |[3] 



R=l- 



3 3 



M 

^ = 1 

A, TV 



(47) 



leads to the theorem. ■ 
An important consequence of Theorems [5] and [4] is that 
regular LDPC codes with (i„ < 4 cannot be decoded without 
an error floor using binary message-passing decoders. To see 
this, observe that for regular codes with — 2 or: dy = 3, 
Theorem |4] is satisfied only if dc < 2 and dc < 1.5, 
respectively. Both cases are not possible for codes of positive 
rate. Therefore, although regular LDPC codes with dy = 3 
are attractive from the point of view of a cycle-free analysis 
||8], they have limited use for binary message-passing. To 
demonstrate this fact we show simulation results of such a 
code in Section |VT] 



V. Implementation Aspects 

A. Estimation of the A-Priori Channel 

In Section [III] we assumed that the variable node knows 
the parameters of the extrinsic channel for every iteration, i.e. 
it knows the crossover probabilities of the messages from the 
check nodes to the variable nodes. Suppose we represent these 
crossover probabilities as a sequence of numbers indexed by 
the iteration number. In p7) we showed how this sequence can 
be predicted in advance from the trajectory of the decoder in 
the EXIT chart. Another possibility is to determine a sequence 
of crossover probabilities by simulations. We remark that for 
finite-length codes, such an approach can lead to better results 
than an asymptotic prediction from the EXIT chart. In this 
section, we present an adaptive method which is based on the 
fraction of unsatisfied check nodes |18 | and does not require 
a precomputed sequence of crossover probabilities. 

Estimating the error probability based on the extrinsic 
messages of the check nodes is not possible, because these 
messages depend on the transmitted symbols which are not 
known to the decoder. However, the decoder knows that all dc 
symbols involved in a parity-check equation sum up to zero, 
and it can therefore determine the extrinsic error probability 
Eec from the number of unsatisfied check nodes denoted by 
Mp. Denote the fraction of unsatisfied check nodes as 



Me 

M 



(48) 



This quantity can be seen as the extrinsic error probability of 
a check node of degree dc + 1. Using ^ with leads to an 
estimate of the crossover probability at the input of the check 
node 



1 - (1 - 2e, 



(49) 



The crossover probability probability at the output of the check 
node follows from ^ and ( |49l ) 



1 - (1 - 2e„ 



l-(l-2£,) 
2 



(50) 



This estimate is then used in Q to compute the reliability of 
the extrinsic channel. 
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TABLE I 

Thresholds for code of rate 0.5 and the LDPC code used in (4) 
Sec. 1.6]. 



^threnliold [dD] 



Fig. 4. Thresholds of optimized codes for soft channel information (Rsoft) 
and hard decision channel (iiBSc)- 



B. Majority Decision Rules 

The concept of converting all incoming messages to L- 
values, perform decoding in the L-value domain and sending 
the hard decision from variable to check nodes is useful for 
analyzing binary message-passing decoders. In practice, how- 
ever, these operations are often replaced by majority decision 
rules due to reasons of complexity. Consider a variable node 
of degree d^. Depending on eav, a minimum number of t 
messages (see ( [T2| )) from the check nodes have to disagree 
with the channel messages, in order to change the outgoing 
message of that variable node. This allows the derivation of 
a majority decision rule that is parametrized by Eq,,. Since 
^av = fee we can use the fraction of unsatisfied check nodes 
to adapt the majority decision rule over the iterations. For 
channels with larger output alphabet than binary, a majority 
decision rule has to be defined for every sub-channel (see ( [T9] l- 

VI. Numerical Results 

Using linear programming, we optimized codes using ( |34| i 
with ( |35| ) and ( |42] i and compared them with the capacity of the 
BIAWGN and BSC. For the optimization we set the maximum 
variable node degree to dy^max = 100 and performed the 
optimization for check node degrees in the range between 2 
and 1000. The decoding thresholds of these codes in terms of 
the required signal to noise ratio are shown in Figure |4] Note 
that cycles of the kind described in Theorem |3] could occur 
if a random interleaver was used. However, we constructed 
our codes using the progressive edge-growth (PEG) algorithm 
IT9) , pO) which ensures that such cycles do not exist. 

Observe that the gap to capacity decreases as the rate 
increases. This makes binary message-passing decoders attrac- 
tive for applications which require a high code rate. For a rate 
of 0.9, the best code using soft channel information is within 
approximately 0.5 dB of capacity. Note that the soft-decision 
and hard-decision channel EXIT curves serve as upper and 
lower bounds, respectively, for all quantization schemes. 
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We performed bit error rate simulations for codes of rate 
R — 0.5 for the BSC, BSQC and the soft information channel. 
The thresholds of these codes using the associated quantization 
schemes are shown in Table |l] where Qi is the quantization 
interval (see Section |III-C| l that leads to the best threshold. 
The bit error rate simulation results are shown in Figure |5] 
using codes of length N = IC*. Also shown in this figure 
are the results for a regular LDPC code with variable node 
degree d^ — Z and check node degree dc — Q transmitted over 



a channel with soft outputs. As expected from Section IV-C 
this code shows an error-floor. 
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Fig. 5. Bit error rate simulations for optimized and regular code of rate 
R = 0.5. 



The system with hard channel decisions (BSC) corresponds 
to the Gallager B algorithm. Observe that by adding one more 
bit for the channel messages and quantizing them according to 
a BSQC, the performance of this algorithm can be improved 
by 1.0 dB with only a small increase in decoding complexity. 
A finer quantization of the channel messages will not result in 
a significant gain, since the gap to the unquantized system 
is only approximately 0.5 dB. Remark that predicting the 
sequence of crossover probabilities by using the trajectory in 
the EXIT chart |17| gives a similar performance. 

To demonstrate the performance of binary message-passing 
decoders for high code rates we perform bit error rate simu- 
lations of a code used in |4j Section 1.6]. This code of rate 
R = 0.9375 is a regular LDPC code with d^ = 7, 4 = 112 
and is used for an optical transmission system for high data 
rates up to 40 Gbps. The slopes which define the code (for 
details see |4 Section 1.6.2]) are not defined in the standard 
and have been chosen to be the first seven prime numbers. 



g 



i.e., 2, 3, 5, 7, 11, 13, 17. In fT] it is assumed that the decoder 
observes hard decisions from the channel. Using our analysis, 
the thresholds for channels with larger output alphabets are 
shown in Table |l] assuming that the unquantized channel can 
be modeled as a BIAWGN channel. The corresponding bit 
error rate simulations are shown in Figure [6] Increasing the 
number of quantization levels of the channel messages by one 
bit leads to an improvement of approximately 1.0 dB. 
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Fig. 6. Bit error rate simulations for the LDPC code of rate R = 0.9375 
used in (4] Sec. 1.6]. 

VII. Conclusions 

We analyzed binary message-passing decoders using EXIT 
charts. For channels which deliver hard decisions, this analysis 
led to an algorithm that is equivalent to Gallager's decoding 
algorithm B. We extended these results to channels with larger 
output alphabets including channels providing soft informa- 
tion. We found that increasing the channel output alphabet 
size by only one bit leads to a significant lowering of the 
decoding threshold. We described why the mixing property 
of EXIT functions does not apply to binary message-passing 
algorithms if one uses mutual information, and presented a 
modified mixing method based on error probabilities in order 
to optimize codes. Finally, we showed that degree two and 
three variable nodes forming a cycle cannot be corrected and 
we derived a condition for the variable node distribution that 
guarantees the existence of a cycle-free subgraph for these 
nodes. 
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